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Preface 



The Condition of Education summarizes important developments and trends in 
education using the latest available data. The report, which is required by law, is 
an indicator report intended for a general audience of readers who are interested 
in education. The indicators represent a consensus of professional judgment on 
the most significant national measures of the condition and progress of educa- 
tion for which accurate data are available. The 2006 print edition includes 50 
indicators in five main areas: (1) enrollment trends and student characteristics 
at all levels of the education system from early childhood education to graduate 
and first-professional programs; (2) student achievement and the longer term, 
enduring effects of education; (3) student effort and rates of progress through 
the educational system among different population groups; (4) the contexts of 
elementary and secondary education in terms of courses taken, teacher charac- 
teristics, and other factors; and (5) the contexts of postsecondary education. 

The 2006 edition also includes a special analysis that presents key findings of 
recent international assessments that examine the performance of U.S. students 
in reading, mathematics, and science and the literacy of adults compared with 
the performance of their peers in other countries. To make the special analysis 
available to audiences interested in U.S. performance on international assessments 
of educational achievement, the special analysis is reprinted here as a separate 
volume. Technical notes about the data sources, methodology, and standard er- 
rors are included at the end of this booklet. 

Special analyses included in the 2000-06 editions of The Condition of Educa- 
tion are available both as booklets and in the full print volumes. They are also 
available on the NCES Condition of Education website f http://nces.ed.gov/ 
programs/coe ). 
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U.S. Student and Adult Performance 
on International Assessments of 
Educational Achievement 



Introduction 

As part of its congressional mandate, the National Center for Education Statis- 
tics (NCES) is required to report on the state of education in the United States 
and other countries (Education Sciences Reform Act of 2002). To carry out this 
mission, NCES engages in a number of activities designed to gather information 
and produce indicators on how the performance of U.S. students, teachers, and 
schools compares with that of their counterparts in other countries. NCES and 
other offices within the U.S. Department of Education work with foreign minis- 
tries of education and international organizations, such as the Organization for 
Economic Cooperation and Development (OECD), the International Association 
for the Evaluation of Educational Achievement (IEA), and the United Nations 
Educational, Scientific and Cultural Organization (UNESCO) to plan, develop, 
and implement reliable and meaningful measures across countries. 

The United States participates in several international assessments designed to 
provide comparable information about achievement in various subject areas. 
These assessments offer an opportunity to compare the performance of U.S. stu- 
dents and adults with that of their peers in other countries. They also provide an 
opportunity to observe characteristics associated with high and low achievement 
across countries and to posit questions about policies and practices that could 
be applied in U.S. schools to improve student learning. 

The United States has participated in developing and conducting cross-national 
assessments since the 1960s. Since the first comparative assessments were given, the 
number and scope of international assessments have grown. The implementation 
of technical standards and increased monitoring, along with the expertise that the 
international community has contributed to assessment design, has improved the 
quality of data over time. For complete details on the methods instituted to ensure 
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data quality and comparability, see Adams (2005); Martin, Mullis, and Chrostowski 
(2004); Martin, Mullis, and Kennedy (2003); and Statistics Canada (2005). 

Currently, the United States participates in four international assessments: the 
Progress in International Reading Literacy Study (PIRLS), which assesses reading 
performance in grade 4; the Program for International Student Assessment (PISA), 
which assesses the reading, mathematics, and science literacy of 15-year-olds; 1 the 
Trends in International Mathematics and Science Study (TIMSS), which assesses 
mathematics and science performance in grades 4 and 8; and the Adult Literacy 
and Lifeskills Survey (ALL), which assesses the adult literacy and numeracy skills 
of 16- to 65-year-olds (table 1). Each international assessment measures one or 
more dimensions of the performance or ability of U.S. students or adults. Com- 
bined with data from national assessments, 2 these international assessment data 
provide educators and policymakers with a more complete picture of educational 
achievement in the United States. 

This special analysis will present major findings from each of these assessments. 
The purpose of this special analysis is three-fold: (1) to discuss the similarities and 
differences in the countries participating in the assessments; (2) to report the most 
recent findings of these assessments; and (3) to compare the overall performance 
of students and adults in the United States with their peers in other countries. 



Which Countries Participate? 

Countries around the world are invited to participate in each assessment by the 
sponsoring international organization. Because they volunteer to participate, the 
number and range of countries (e.g., developed vs. developing) vary from assess- 
ment to assessment. Though TIMSS, PIRLS, and PISA include developed and de- 
veloping countries, a larger proportion of developing countries have participated 
in TIMSS and PIRLS than in PISA and ALL (table 1). PISA is primarily adminis- 
tered in the member countries of the OECD — an intergovernmental organization 
of 30 industrialized countries seeking to promote trade and economic growth. 
ALL was conducted only among 6 countries in 2003, but additional countries 
collected data in 2005, and more countries plan to participate in future years. 

Differences in the combinations of countries that participate in the assessments can 
affect how various measures, such as the international average, are calculated and 
interpreted. For example, because national average scores in developing countries 
tend to be lower than those in developed countries, the international averages 
can vary from administration to administration, depending on which countries 
participate. In TIMSS and PIRLS, the international averages are calculated using 
results from both developing and developed countries while in PISA, they are 
calculated using results only from the OECD-member countries. 
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Table 1 . Recent international assessments 



Average GDP 
per capita of Average 











Number 


participating 


HDI of 








Year 


of partici- 


countries 


partici- 




Age/grade 


Subjects 


admin- 


pating 


(in U.S. dollars 


pating 


Study 


assessed 


assessed 


istered 


countries’ 


using PPP) 2 


countries 3 


Progress in Inter- 


4th grade 


Reading 


2001 


35 


$13,229 


0.865 


national Reading 






2006 








Literacy Study 














(PIRLS) 














Trends in Inter- 


4th grade 


Mathematics 


1995 


25 at 


$15,911 


0.863 


national Mathe- 


8th grade 4 


Science 


1999 


grade 4; 


(grade 4); 


(grade 4); 


matics and Science 






2003 


45 at 


$10,808 


0.820 


Study (TIMSS) 






2007 


grade 8 


(grade 8) 


(grade 8) 


Program for 


15-year-olds 


Reading literacy 


2000 


39 


$26,172 


0.917 


International 




Mathematics 


2003 








Student Assess- 




literacy 


2006 








ment (PISA) 




Science literacy 










Adult Literacy 


16- to 


Literacy 


2003 


6 


$33,598 


0.947 


and Lifeskills 


65-year-olds 


Numeracy 










Survey (ALL) 















' Number of participating countries based on the most recently completed year of the assessment. 

2 Average gross domestic product (GDP) per capita is based on the averages of the participating countries in 2003 that completed all necessary 
steps to appear in the international reports. GDP per capita is taken from the United Nations Development Program (UNDP) Human Develop- 
ment Report 2005. Figures are converted using purchasing power parity (PPP) conversion factors that take into account differences in the 
relative prices of goods and services — particularly non-tradables — and therefore provide a better overall measure ofthe real value ofoutput 
produced by an economy compared to other economies. PPP GDP is measured in current international dollars which, in principle, have the 
same purchasing power as a dollar spent on gross national index in the U.S. economy. Average GDP per capita for PISA includes Organization 
for Economic Cooperation and Development (OECD)-member nations only. Average GDP per capita for TIMSS, PIRLS, and ALL includes all na- 
tions for which data were available. GDP per capita data were unavailable for Bermuda, Chinese Taipei, Lichtenstein, Macao-China, Palestinian 
National Authority, and Serbia and are thus not included in the averages. 

3 Average Human Development Index (HDI) is based on the HDI of particpating countries in 2003 and includes only those countries that 
completed all necessary steps to appear in the international reports.The HDI is a composite index that takes into account three dimensions of 
human development: life expectancy; knowledge;and standard of living.HDI figures are taken from the UNDP Human Development Report 2005. 
HDI scores range from 0 (lowest) to 1 (highest). Average HDI for PISA includes OECD-member nations only. Average HDI forTIMSS, PIRLS, and 
ALL includes all nations for which data were available. HDI figures were unavailable for Bermuda, Chinese Taipei, Lichtenstein, Macao-China, 
and Serbia and are thus not included in the averages. 

4 Lourth-graders were only assessed in 1 995 and 2003. 

SOURCEdnternational Association forthe Evaluation of Educational Achievement (IEA),Progress in International Reading Literacy Study (PIRLS), 
2001 ;Trends in International Mathematics and Science Study (TIMSS), 2003;Statistics Canada and Organization for Economic Cooperation and 
Development (OECD), Adult Literacy and Lifeskills Survey (ALL),2003;OECD, Program for International Student Assessment (PISA),2003;and 
United Nations Development Program (UNDP), Human Development Report 2005, previously unpublished tabulation (October 2005). 
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How Comparable Are the Schools and Students That Participate? 

One challenge in comparing assessment data from countries around the world is 
determining the extent that variations in the characteristics of student and adult 
populations relate to achievement scores. For example, restrictions in attrition 
rates as students move through the educational system, the economic and social 
status of students and their families, and parental levels of education may each 
affect the comparability of findings both within and across assessments. In de- 
veloping international assessments, the challenge of making student populations 
comparable is generally dealt with in two ways. 

First, countries that participate in international assessments such as TIMSS, PIRLS, 
ALL, and PISA are required to select national probability samples from all stu- 
dents or adults in a particular grade or of a particular age. Exclusions are strictly 
limited, must be clearly documented, and are reported along with participation 
rates at each level of sampling. Countries with exclusion rates that are above 
established levels or with samples that are not representative of the population 
being assessed run the risk of being eliminated from reports. 

Second, in the school-based assessments, the grades or ages selected for assessment are 
chosen to maximize the likelihood of youth being enrolled in school; for example, PISA 
samples are drawn from the population of 15-year-old students enrolled in school. 
In 2003, the most recent year for which data are available, the percentage of the 
population ages 5-14 enrolled in school was 90 percent or higher in most developed 
countries, including the United States, and 80 percent or higher in most developing 
countries that participated in international assessments (OECD 2004a, table C1.2). 
The percentage of the U.S. population ages 15-19 enrolled in public or private school 
was 75 percent, which is comparable to or below that of most other industrialized 
countries. Comparisons of graduation rates from upper secondary school (high school 
in the United States) paint a similar picture: the U.S. graduation rate (73 percent) is 
comparable to or below that of most industrialized countries, where 80 percent or 
more of students finish upper secondary school (OECD 2004a, table A2.1). 

Further differences among countries in terms of their student population charac- 
teristics, especially those found to be significantly related to achievement, can also 
be evaluated and explained in comparative analyses. Research has established that 
students’ economic and social characteristics, such as their immigrant status and 
family income, are associated with academic achievement (Coleman et al. 1966; 
Entwisle and Alexander 1993; Shavit and Blossfield 1993). Moreover, research 
has shown that these factors are often interrelated, further complicating the 
picture (McLanahan and Sandefur 1994; Schmid 2001). For example, minority 
status, family income, language ability, and family structure are associated with 
students’ achievement in the United States (Coleman et al. 1966; Jencks et al. 
1979; McLanahan and Sandefur 1994; Schmid 2001), and such relationships are 
also found in many other countries (Buchmann 2002). The uneven distribution 
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of students’ economic and social factors across countries, as well as the potential 
cross-national variation in the relationship between student achievement and these 
factors, may affect the outcomes of cross-national comparisons. 

Recent comparisons of PISA 2003 data have explored how variations in student 
population characteristics across countries may affect the reported outcomes of 
international studies. For example, it is true that some characteristics of the U.S. 
student population are different from those of student populations in countries 
like Japan and Korea, where there are few foreign-born students; however, student 
populations in other countries are often not measurably different from the U.S. 
student population in terms of the distribution of salient social and economic fac- 
tors (figures 1 and 2; Hampden-Thompson and Johnston 2006). For example, 48 
percent of 15-year-old students in the United States reported having at least one 
parent who had a college degree or a postsecondary vocational qualification (figure 
1). When the United States was compared to the other 19 countries in this study, 
11 countries were found to have a smaller percentage of students with postsecond- 
ary-educated parents when compared with the United States. Seven countries had 
a higher percentage of 15-year-old students who reported that at least one of their 
parents was educated to the postsecondary level (Australia, Belgium, Canada, Den- 
mark, Finland, Norway, and Sweden). Also, the data show that 9 percent of U.S. 
15-year-olds did not speak the language of the test at home (i.e., English; figure 2). 
Of the 19 other countries, 6 had a greater percentage of 15-year-olds who did not 
speak the language of the test at home, and 8 countries had a lower percentage. 

Cross-national comparisons of student populations and their social and economic 
contexts show that the United States shares many of the same educational chal- 
lenges as other countries. For example, while the strength of the association 
may vary, many studies report a fairly consistent relationship between lower 
socioeconomic status and lower student achievement (Buchmann 2002). The 
cross-national comparisons of achievement displayed in the sections that follow 
have not been adjusted for socioeconomic or other factors. 



How Do U.S. Students and Adults Compare With Their Peers in Other 
Countries? 

Results for U.S. students and adults on international assessments vary by subject, 
grade or age, and assessment. Although it would be desirable, it is not possible to 
directly compare the international assessment scores from the various studies be- 
cause of differences in the countries participating, the purpose of the assessments, 
the items used, and the target populations. Without making direct comparisons 
between studies, the following section presents highlights of the key findings of 
several recent international studies that looked at students’ and adults’ achieve- 
ment in reading, mathematics, and science. 
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Figure 1. Percentage of 15-year-olds whose parents had a postsecondary education, had high 
occupational status, and had more than 200 books in the home, by country: 2003 



Country 

International 

average 

Australia 
Austria 
Belgium 
Canada 
Denmark 
Finland 
France 
Germany 
Greece 
Iceland 
Ireland 
Italy 
Netherlands 
New Zealand 
Norway 
Portugal 
Spain 
Sweden 
Switzerland 
United States 



Postsecondary 
educated parents 




0 20 40 60 80 



More than 200 

High parents' occupation 1 books in the home 




100 0 20 40 60 80 100 0 20 40 60 80 100 

Percent 



1 Parents' occupation is reported by the student and coded to the International Standard Classification of Occupations (ISCO-88) and then 
grouped into major occupational groups. For further information, see Ganzeboom et al. (1 992). 

N0TE:The international average is the weighted mean of the data values for the 20 countries included in the analysis. Parent education, parent 
occupational status, and number of books in the home are based on students' reports. If either of a student's parents completed a bachelor's, 
master's, or postgraduate degree (corresponding tothe International Standard Classification of Education (ISCED) levels 5 A,5B, or 6),the student 
was considered as having postsecondary-educated parents. Parent occupational status is based on either of the student's parents' occupation 
(whichever is higher), and the variable was transformed into quarters with "high” occupational status representing the upper quarter. The 
response rate in New Zealand for parent occupational status was below 85 percent. 

SOU RCE:Hampden-Thompson,G., and Johnston, J.S. (2006). Variation in the Relationship Between Nonschool Factors and Student Achievement 
on International Assessments (UQ.S 2006-014), table 1. Data from Organization for Economic Cooperation and Development (OECD), Program 
for International Student Assessment (PISA), 2003. 
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Figure 2. Percentage of 1 5-year-olds who spoke a non-test language, were foreign born, and were 
from non-two-parent families, by country: 2003 



Country 

International 

average 

Australia 
Austria 
Belgium 
Canada 
Denmark 
Finland 
France 
Germany 
Greece 
Iceland 
Ireland 
Italy 
Netherlands 
New Zealand 
Norway 
Portugal 
Spain 
Sweden 
Switzerland 
United States 
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0 20 40 60 80 100 0 20 40 60 80 100 0 20 40 60 80 100 

Percent 



NOTE: The international average is the weighted mean of the data values forthe 20 countries included in the analysis. Language spoken at 
home, immigrant status, and family structure are based on students' reports. "Test-language" students reported speaking the language in 
which the test was administered always or most of the time at home while "non-test-language" students reported using another language 
always or most of the time at home. Students from a "two-parent family” reported living with both their mother and father. The category 
"non-two-parent family" encompasses all other responses. 

SOU RCE:Hampden-Thompson,G., and Johnston.J.S. (2006). Variation in the Relationship Between Nonschool Factors and Student Achievement 
on International Assessments (NCES 2006-014), table 1. Data from Organization for Economic Cooperation and Development (OECD), Program 
for International Student Assessment (PISA), 2003. 
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Reading 



Three international assessments measure aspects of reading skills. The Progress 
in International Reading Literacy Study (PIRLS) assesses 4th-grade reading skills; 
the Program for International Student Assessment (PISA) focuses on the ability 
of 15 -year-olds to apply their reading skills to a wide variety of materials within 
a real-life context; and the Adult Literacy and Lifeskills Survey (ALL) assesses 
the literacy skills of adults ages 16-65. 

PIRLS 

Administered in 35 countries in 2001, PIRLS defines reading literacy as 

The ability to understand and use those written language forms required 
by society and/or valued by the individual. Young readers can construct 
meaning from a variety of texts. They read to learn, to participate in com- 
munities of readers in school and everyday life, and for enjoyment. (Mullis 
et al. 2004a, p. 3). 

To measure the reading literacy skills and abilities of 4th-graders, PIRLS used 
a combination of literary texts — passages drawn from children’s books — and 
informational texts — passages providing information on people, places, and 
things. Students were asked to demonstrate skills and abilities such as retrieving 
specific information, making inferences, interpreting and integrating ideas and 
information, and examining and evaluating content and language. 

■ U.S. 4tb-graders bad higher average reading literacy scores 
than the international average and higher scores than stu- 
dents in 23 of the 34 other participating countries in 2001. 

The results from PIRLS indicate that U.S. 4th-graders performed as well as or 
better than most of their international peers in the other 34 participating coun- 
tries (table 2). Specifically, U.S. 4th-graders performed above the international 
average, and, on average, they outperformed students in two-thirds of the other 
participating countries. The performance of students in about one-quarter of the 
participating countries was not measurably different from that of U.S. students. 
Students in three countries (Sweden, the Netherlands, and England) outperformed 
U.S. students, on average. The average score of U.S. 4th-graders was not measur- 
ably different from the average student scores in other industrialized countries 
such as Canada (Ontario and Quebec), Italy, and Germany. U.S. 4th-graders 
outscored their peers in some industrialized countries, such as New Zealand, 
Scotland, France, and Norway, as well as in a number of developing countries. 

In addition to overall reading scores, PIRLS provides subscale scores for specific 
reading skills: reading for literary experience and reading to acquire and use infor- 
mation. On average, U.S. 4th-graders performed as well as or better than their peers 
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Table 2. Average PIRLS reading literacy scores of 4th-graders, by country: 2001 



Country 


Average score 


International average 


500 


Sweden 


561 


Netherlands’ 


554 


England 12 


553 


Bulgaria 


550 


Latvia 


545 


Canada (0,Q) 3 - 4 


544 


Lithuania 3 


543 


Hungary 


543 


United States’ 


542 


Italy 


541 


Germany 


539 


Czech Republic 


537 


New Zealand 


529 


Scotland 1 


528 


Singapore 


528 


Russian Federation 2 


528 


Hong Kong SAR 5 


528 


France 


525 


Greece 2 


524 


Slovak Republic 


518 


Iceland 


512 


Romania 


512 


Israel 2 


509 


Slovenia 


502 


Norway 


499 


Cyprus 


494 


Moldova 


492 


Turkey 


449 


Macedonia 


442 


Colombia 


422 


Argentina 


420 


Iran 


414 


Kuwait 


396 


Morocco 6 


350 


Belize 


327 



■ Average is higherthan the U.S.average. 

□ Average is not measurably different from the U.S.average. 
Average is lower than the U.S.average. 

1 Met international guidelines for sample participation rates only 
after replacement schools were included. 

2 National defined population covers less than 95 percent of national 
desired population. 

J National desired population does not cover all of international 
desired population. 

4 Canada is represented by the provinces of Ontario and Quebec 
(0,Q) only. 

5 Hong Kong SAR is a Special Administrative Region (SAR) of the 
People's Republic of China. 

6 Nearly satisfied guidelines for sample participation rates after 
replacement schools were included. 

NOTE: Participants were scored on a 1,000-point scale. The inter- 
national standard deviation is 100 points.The test for significance 
between the U.S. average and the international average was 
adjusted to account for the contribution of the U.S. average to the 
international average. 

SOURCE: Ogle, L.T., Sen, A., Pahlke, E, Jocelyn, L., Kastberg, D, Roey, 
S., and Williams,! (2003). International Comparisons in Fourth- 
Grade Reading Literacy: Findings from the Progress in International 
Reading Literacy Study (PIRLS) of 2001 (NCES 2003-073), figure 
3. Data from International Association for the Evaluation of Edu- 
cational Achievement, Progress in International Reading Literacy 
Study (PIRLS), 2001. 



in most countries in both reading subscales (Ogle et al. 2003). Students in only one 
country, Sweden, outperformed U.S. students in reading for literacy experience; 
students in five countries (Sweden, the Netherlands, Bulgaria, Latvia, and England) 
outperformed U.S. students in reading to acquire and use information. 

As with all international assessments in which the United States participates, 
PIRLS data can be analyzed to provide information on the achievement of student 
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subpopulations. For example, 19 percent of U.S. students performed among the 
top 10 percent of all 4th-graders across the 35 countries that participated in PIRLS 
in 2001, a percentage exceeded only in England (Ogle et al. 2003). Among U.S. 
4th-graders, a larger percentage of White students performed in the top 10 percent 
of all students than their Black or Hispanic peers. In all 35 countries, including 
the United States, girls outperformed boys in reading. Girls in Sweden, England, 
the Netherlands, and Bulgaria outperformed U.S. girls in reading, on average, 
while boys in the Netherlands and Sweden outperformed U.S. boys. 

PIRLS will be repeated in 2006, providing more information about the progress 
of U.S. students in reading relative to other countries. Results of the PIRLS 2001 
assessment can be found in Ogle et al. (2003; available at http://nces.ed.gov/ 
pubsearch/pubsinfo.asp?pubid=2003073 1 and Mullis et al. (2003; available at 
http://isc.bc.edu/pirls2001i/PIRLS2001 Pubs IR.html l. 

PISA 

PISA measured the reading literacy of 15-year-olds in 2000. In this study, reading 
literacy was defined as “understanding, using, and reflecting on written texts in 
order to achieve one’s goals, to develop one’s knowledge and potential, and to 
participate in society” (OECD 1999, p. 20). PISA measured the extent to which 
students could apply different reading processes (retrieving information, interpret- 
ing text, and reflecting on text) to a range of reading materials they were likely 
to encounter as young adults, such as government forms, newspaper articles, 
manuals, books, and magazines. 

■ U.S. 15-year-olds scored at the OECD average in reading 
literacy in 2000. 

PISA 2000 results showed that U.S. 15-year-olds performed as well as or better 
than most of their peers in the 30 other participating countries (table 3). On 
average, students in Finland, Canada, and New Zealand outperformed U.S. 
students, but the U.S. average scores were not significantly different from those 
in most other industrialized countries as well as the OECD average. 3 PISA also 
provided subscale scores based on processes used when reading a text: retriev- 
ing information from text; interpreting texts; and reflecting on texts to relate to 
other experiences, knowledge, or ideas. U.S. 15-year-olds scored at the OECD 
average on all three reading processes measured. However, students in five coun- 
tries outperformed U.S. students on a measure of retrieving information, and 
students in four countries outperformed U.S. students on a measure of reflecting 
on texts. On a measure of interpreting texts, students in two countries — Finland 
and Canada — outperformed U.S. 15-year-olds (Lemke et al. 2001). 

Thirteen percent of U.S. students performed among the top 10 percent of all 15- 
year-olds in the OECD-member countries that participated in PISA 2000 (Lemke 
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Table 3. Average PISA reading literacy scores of 15-year-olds, by country: 2000 



Country 


Average score 


OECD average 


500 


OECD countries 


Finland 


546 


Canada 


534 


New Zealand 


529 


Australia 


528 


Ireland 


527 


Korea, Republic of 


525 


United Kingdom 


523 


Japan 


522 


Sweden 


516 


Austria 


507 


Belgium 


507 


Iceland 


507 


Norway 


505 


France 


505 


United States 


504 


Denmark 


497 


Switzerland 


494 


Spain 


493 


Czech Republic 


492 


Italy 


487 


Germany 


484 


Fiungary 


480 


Poland 


479 


Greece 


474 


Portugal 


470 


Luxembourg 


441 


Mexico 


422 



Country 


Average score 


Non-OECD countries 


Liechtenstein 


483 


Russian Federation 


462 


Latvia 


458 


Brazil 


396 



■ Average is higher than the U.S. average. 

□ Average is not measurably different from the U.S. average. 
Average is lower than the U.S.average. 



NOTE:The test for significance between the United States and the 
Organization for Economic Cooperation and Development (OECD) 
average was adjusted to account for the contribution of the U.S. 
average to the OECD average. Because PISA is principally an OECD 
study, the results for non-OECD countries are displayed separately 
from those for the OECD countries and are not included in the OECD 
average. Due to low response rates, data for the Netherlands are 
not included. Participants were scored on a 1,000-point scale. The 
international standard deviation is 100 points. 

SOURCE: Lemke, M., Calsyn, C., Lippman, L, Jocelyn, L, Kastberg, D., 
Liu, Y.Y.,Roey,S., Williams, T., Kruger, T., and Bairu,G.(2001 ). Outcomes 
of Learning: Results From the 2000 Program for International Student 
Assessment of 15-Year-Olds in Heading, Mathematics, and Science 
Literacy (NCES 2002-1 15), figure 3. Data from Organization for 
Economic Cooperation and Development (OECD), Program for 
International Student Assessment (PISA), 2000. 



et al. 2001), and about one-third of U.S. students were found to read at the two 
highest levels of performance. Similar to the results in the PIRLS 2001 study, girls 
outperformed boys in reading literacy in the United States and all other participat- 
ing PISA countries (Lemke et al. 2001). More information on the performance of 
other student population groups can be found in Lemke et al. (2001; available at 
http://nces.ed. gov/pubsearch/pubsinfo.asp?pubid=20021 15 ) and OECD (2001; 
available at https://www.pisa.oecd.org/dataoecd/44/53/33691596.pdf ). 

ALL 

In 2003, the United States participated in ALL along with five other countries. 
The study assessed the literacy and numeracy skills of adults ages 16-65 through 
a written test administered in respondents’ homes. In this study, literacy was 
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defined as the knowledge and skills needed by adults, in life and at work, to use 
information from various texts (e.g., news stories, editorials, manuals, brochures) 
in various formats (e.g., texts, maps, tables, charts, forms, time tables) (Statistics 
Canada and OECD 2005). The ALL test questions were developed to assess the 
respondent’s ability to retrieve, compare, integrate, and synthesize information 
from texts and to make inferences, among other skills. 

■ U.S. adults had lower literacy skills, on average, than 
adults in Norway, Bermuda, Switzerland, and Canada in 
2003 and had higher literacy skills than adults in Italy. 

Results from ALL showed that U.S. adults outperformed adults in Italy in 2003, 
but were outperformed by adults in Norway, Bermuda, Switzerland, and Canada 
(table 4). Adults in Bermuda, Norway, and Canada had higher literacy scores 
than U.S. adults at both the high and low ends of the score distribution (Lemke 
et al. 2005). The highest performers (the top 10 percent of adults) had literacy 
scores of 353 or higher in Bermuda, 348 or higher in Norway, and 344 or higher 
in Canada, compared with 333 or higher in the United States. The lowest per- 
formers (those in the bottom 10 percent) in Bermuda had literacy scores of 213 
or lower, 233 or lower in Norway, and 209 or lower in Canada, compared with 
201 or lower in the United States. The lowest performers in Switzerland also 
outperformed their U.S. counterparts in literacy, scoring 216 or lower. 

In contrast to the results in PIRLS and PISA, there was no measurable differ- 
ence in the literacy performance of men and women in the United States and in 
Bermuda, Canada, and Norway (Lemke et al. 2005). In Italy and Switzerland, 
men outperformed women. In the United States, White adults outscored Black 
and Hispanic adults, on average, on literacy tasks. 

More countries will have collected data by 2005, allowing for additional com- 
parisons of adult skills and knowledge. Detailed information on the results from 
ALL 2003 can be found in Statistics Canada and OECD (2005; available at http:// 
www.statcan.ca/english/freepub/89-603-XIE/2005001/pdf.htm ). 



Table 4. Average ALL literacy scores of adults ages 1 6-65, by country: 2003 



Country 


Average score 


Norway 


293 


Bermuda 


285 


Switzerland 


274 


Canada 


281 


United States 


269 


Italy 


228 



■ Average is higher than the U.S. average. 

□ Average is not measurably different from the U.S. average. 
Average is lower than the U.S. average. 



NOTE: Participants were scored on a 500-point scale. 

SOURCE: Lemke, M, Miller, D., Johnston, J.,Krenzke,T., Alvarez-Rojas, 
l.,Kas\hetq,D., and loa\yn,L(2005).Highlights From the2003 Inter- 
national Adult Literaq and Lifeskills Survey (ALL) — (Revised) (NCES 
2005-1 1 7rev), table 1 . Data from Statistics Canada and Organization 
for Economic Cooperation and Development (OECD), Adult Literacy 
and Lifeskills Survey (ALL), 2003. 
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Mathematics 



Three international assessments measure aspects of mathematical skills. The Trends 
in International Mathematics and Science Study (TIMSS), which assesses 4th- and 
8th-grade mathematics knowledge and skills; the Program for International Stu- 
dent Assessment (PISA), which focuses on mathematics literacy, or the ability of 
15-year-olds to apply mathematics to a wide variety of materials within a real-life 
context; and the Adult Titeracy and Lifeskills Survey (ALL), which measures the 
numeracy skills of adults ages 16-65. 

TIMSS 

TIMSS, which was administered in grades 4 and 8 in 1995 and 2003 and in 
grade 8 in 1999, is designed to measure the achievement of 4th- and 8th-graders 
in mathematics and science. The study is closely linked to the curricula of the 
participating countries, providing an indication of the degree to which students 
have learned the concepts of mathematics that they have studied in school. Some 
46 countries participated in TIMSS in 2003, at either the 4th- or 8th-grade level, 
or both. 



■ From 1995 to 2003, U.S. 4th-graders showed no measur- 
able change in their mathematics performance, while the 
performance of 8th-graders improved. 

In mathematics, students in some countries (notably several Asian countries, 
such as Japan and Hong Kong, but also including the Netherlands and Belgium) 
consistently outperformed U.S. students, on average, regardless of the year of as- 
sessment, measure, grade, or age tested (Gonzales et al. 2004). Overall, however, 
the current picture of U.S. performance, as measured by TIMSS, is mixed at the 
4th- and 8th-grade levels. 

When comparing the United States with the other 24 countries participating at 
grade 4 in 2003, U.S. 4th-graders performed better, on average, than their peers 
in 13 countries but worse than their peers in 11 countries (table 5). TIMSS also 
provided scores for five mathematics content areas at grade 4: number, patterns 
and relationships, measurement, geometry, and data. U.S. 4th-graders performed 
above the international average in four of the five content areas in 2003 (all but 
measurement); they performed best in data and least well in measurement (Mul- 
lis et al. 2004b). 

Comparing results from 1995 and 2003 suggests that while the performance of 
U.S. students was stable during this period, it did not keep pace with improved 
scores among students in several other countries (Gonzales et al. 2004). That is, 
of the other 14 countries participating in both 1995 and 2003, 4th-graders in 
more countries outperformed their U.S. peers in 2003 than in 1995, on average. 
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